What ROC Curves Can't Do (and Cost Curves Can)
نویسندگان
چکیده
This paper shows that ROC curves, as a method of visualizing classifier performance, are inadequate for the needs of Artificial Intelligence researchers in several significant respects, and demonstrates that a different way of visualizing performance – the cost curves introduced by Drummond and Holte at KDD’2000 – overcomes these deficiencies.
منابع مشابه
Technical Note: Towards ROC Curves in Cost Space
ROC curves and cost curves are two popular ways of visualising classifier performance, finding appropriate thresholds according to the operating condition, and deriving useful aggregated measures such as the area under the ROC curve (AUC) or the area under the optimal cost curve. In this note we present some new findings and connections between ROC space and cost space, by using the expected lo...
متن کاملProper Use of ROC Curves in Intrusion/Anomaly Detection
ROC curves (receiver operating characteristic curves) are commonly used to portray the performance of detectors in signal-detection tasks, such as intrusion detection. This report introduces the origins of signal-detection-theory, and the underpinnings of ROC curves. It provides examples of how to construct these curves, as well as how to measure, interpret and compare them. Information about a...
متن کاملA graphical analysis of cost-sensitive regression problems
Several efforts have been done to bring ROC analysis beyond (binary) classification, especially in regression. However, the mapping and possibilities of these proposals do not correspond to what we expect from the analysis of operating conditions, dominance, hybrid methods, etc. In this paper we present a new representation of regression models in the so-called regression ROC (RROC) space. The ...
متن کاملFetal Growth Curve in Neonates in Alzahra Hospital in Rasht
ABSTRACT Evaluation of intrauterine growth and determination of at risk neonates was done by weight criteria for each pregnancy age. This criteria in different populations is not similar. Main objective of this study was determination of intrauterine growth pattern in this region. Weights of 2380 term neonates and 788 preterm neonates that had a definite LMP and were born at Alzahra hospital i...
متن کاملConstructing Hypothetical Risk Data from the Area under the ROC Curve: Modelling Distributions of Polygenic Risk
BACKGROUND Modeling studies using hypothetical polygenic risk data can be an efficient tool for investigating the effectiveness of downstream applications such as targeting interventions to risk groups to justify whether empirical investigation is warranted. We investigated the assumptions underlying a method that simulates risk data for specific values of the area under the receiver operating ...
متن کامل